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DISPLAY OF DATA ELEMENT INDICIA BASED ON DATA TYPES 

CROSS-REFERENCE TO RELATED APPLICATIONS 
The instant application is related to prior U.S. Patent Application Seri; 
Number 09/520,543, entitled SYSTEM, METHOD, AND ARTICLE 6 
MANUFACTURE FOR A KNOWLEDGEBASE FRAMEWORK, and to prior U.J 
Patent Application Serial Number 09/520,942, entitled SYSTEM, METHOD, AN1 
ARTICLE OF MANUFACTURE' FOR- ORGANIZATION MONITORING, both file 
March 8, 2000, the teachings of which applications are incorporated herein by thi 
reference. 

FIELD OF THE INVENTION . 
The present invention relates generally to computer-unplemented displa> 
and. in particular to a technique for displaying data element indicia based on data type 
corresponding to each data elemenL 

BACKGROUND OF THE INVENTION 
Recent advances in information technology, in particular the Internet an 
World Wide Web, have lead to an unprecedented growth in the amount of data general! 
available to a broad spectrum of users. Recently the size of the Internet has bee 
estimated at approximately 3.2 billion pages growing at a monthly rate of 25'/, 
Additionally, the rate of growth of private Intranets is equally significant 
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As the sheer volume of available information expands, the difficultly : , 

keeping track of newly available information, as well as the ability to discern relevaj 

and desired information becomes increasingly difficult. For example, to do a thoroug 

search, drug discovery scientists will typically have to access over thirty different on-lir 

databases in the course of their normal research. In keeping with current disph 

methodologies, each of these different databases typically relies on keyword searchin 

and linearly presented lists of search results. More importantly, the job of Uackip 

relationships between the data provided by each of these different sources is" typical! 

i • 
done in a manual fashion. While this approach can be effective, it is evident th; 

significant improvements in efficiency could be realized if the vast quantities of availabl 

information could be presented in a more coherent manner. 

Various attempts have been made to improve the manner in whic 

information is presented to users.. For example, U.S. Patent Nos/ 6,03 1,53 7; 6,037,944 

6,166,739; and 6,256,032 issued to Hugh describe a system in which a plurality o 

"thoughts" are organized in such a way that relationships between various thoughts ar 

also included. Using a graphical representation of the resulting thought network, user. 

are able to select individual thoughts and thereby have related thoughts displayed in ; 

hierarchical fashion. Furthermore, U.S. Patent Nos. 5,590,250; and 5,619,632 issued U 

Lamping et al. describe a system in which nodes and links between such nodes are 

displayed through a space having a negative curvature, i.e., a sphere. A parent node i; 

displayed at a parent position, and other nodes having varying degrees of relationship tc 

the parent node are displayed at other positions surrounding the parent position, thereby 

illustrating the network of relationships between the displayed nodes. By selecting and 

2 
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dragging any given node closer to the parent position, the various other related nod« ar 
removed from or added to the displayed area in such a manner so as to provide th 
appearance of a sphere rotating. 

The techniques described in the Hugh and Lamping patents represent a 
advancement in the art due. in part, to the fact that each technique provides an indicatio: 
of relationships between various displayed data elements. However, neither of thcs 
techniques incorporates the use of concepts or -data types to further organize th- 
information displayed. It is believed that a technique that is capable not only o 
displaying relationships between data elements, but that js also capable of organizinj 
such data elements according to data typfc would represent a significant advancement u 
the art. 

SUMMARY OF THE INVENTION 
The present invention provides a technique for displaying a plurality o} 
data elements based, in part, upon data types associated with the. plurality of daU 
elements. In the context of the present invention, a data element comprises any uniquely 
identifiable digital object capable of manipulation by a computer or links thereto. Data 
element indicia comprise any visually-perceptible representation of a data element, e.g., 
graphical icons, video, etc. Data types associated with the data elements indicate the 
content encompassed by each data element The data types, in turn, are defined 
according to a knowledge model representative of the available knowledge within a given 
line of inquiry. When displaying a plurality of data elements, region indicia, defined 
according to the corresponding data types, are displayed. Thereafter, data element indicia 
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representative of the plurality of data elements are displayed within the plurality of 
regions defined by the region indicia according to the data types corresponding to each 
data element indicium. Additionally, relationship indicia representative of a plurality of 
relationships between at least a portion of the data elements may also be displayed. Such 
relationship indicia may be representative of confirmed relationships between data 
elements, or may be representative of potential relationships between "data elements. In a 
presently preferred embodiment, the regions are presented as a 3x3 grid. 

An initial or selected data element indicium is displayed in a focus region 
of the plurality of regions. At least a second data element indicium is displayed in one of 
the other regions relative to the focus region. Thereafter, the second data element 
indicium may be selected for display in the focus region, thereby causing at least a 
portion of the region indicia to be redisplayed based on the second data element indicium 
being displayed in the. focus region. Also, additional data element indicia are thereby 
displayed based on the second data element indicium being displayed in the focus region. 

BRIEF DESCRIPTION OF THE DRAWINGS 
FIG. 1 illustrates a computer based system in accordance with the present 

invention; 

FIG. 2 illustrates a flowchart in accordance with one embodiment of the 
present invention; - 

. FIG. 3 illustrates a flowchart in accordance with another embodiment of 
the present invention; 
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FIG. 4 is a schematic illustration of a knowledge model in accordanc 
with the present invention; 

FIG. 5 is an exemplary illustration of a display in accordance with th 
present invention; 

F7G. 6 is an illustration of an additional display in accordance with th 
present invention; and 

FIGS. 7-9 are flowcharts illustrating an implementation of the preser 

invention. 

DETAILED DESCRIPTION OF A PREFERRED EMB OD fMENT 
OF THE INVENTION 

The present invention may be more readily described with reference U 

HGS. 1-9 below. Referring now to FIG. 1, a system 100 is illustrated comprising ; 

computer 110 coupled to a server 130 that is in turn coupled to a database 140. In ; 

preferred embodiment, the computer 110 is coupled to the server 130 via a public 

network such as the Internet or World Wide Web, or a private network such as ar 

Intranet, or a combination thereof. The server 130 and database 140 collectively define < 

knowledge base framework like that described in co-pending U.S. Patent Applicatior 

Serial No. 09/520,543. Suitable platforms for implementing the server 130 and database 

140 is well known to those having ordinary skill in the art and need not be described in 

greater detail here. As shown in FIG. 1, the database 140 comprises information 

regarding data elements 142, as well as information regarding user bookmarks 144 and 

monitors 146. In the context of the present invention, data elements comprise any 

uniquely identifiable digital objects, or links thereto, capable of manipulation and/or 

5 
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storage by a computer. For example, a .data element may comprise, but is not limited t< 
te>rt, graphics or video files as known Ln the art. Furthermore, rather than storing actu; 
copies of the data elements 142 in the database HO, information indicating where sue 
copies may be accessed (i.e., hyperlinks) may be stored in the database 140. Tb 
bookmarks 144 comprise user-provided information regarding particular data element 
that a given user may wish to quickly access in the future. Additionally, the monitc 
information 146 comprises user-provided information regarding particular data element 
for which a given user desires to receive notifications of modifications or updates. 

As shown, the computer 110 comprises a processor 112 coupled b 
memory 1 14, one or more user input devices 1 16, a display 1 1 8, and a network interfao 
120. The processor 1 12, which may comprise a "PENTIUM" series processor along witl 
any additional co-processors as commonly used in "the art, controls the operation of th< 
computer 110. In particular, the memory 1 14, which may comprise suitable nonvolatile 
storage such as read-only memory (ROM) and/or volatile memory, such as randorr 
access memory (RAM), stores various executable instructions and data structures ir 
accordance with the present invention. In particular, the memory 114 comprises, in 
addition *o an operating system and associated data structures, an application 122 that, 
*vhen executed by the processor 1 12, provides a means for a user of the computer 1 10 to 
access the knowledge base framework embodied by the server 130 and database 140. In 
a presently preferred embodiment, the application 122, when executed, invokes a browser 
124 such as Netscape's Navigator browser or Microsoft's Internet Explorer browser, to 
provide a suitable interface for communicating with the knowledge base framework. 
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Furthermore, the application 122 is preferably writtenin a machine-independent language 

* * 

such as "JAVA" or the like. • 

As known in the art, the user input devices 1 1 6 may comprise a keyboard 
mouse, touch pad, voice recognition, or any other mechanism typically used to provide 
user input to a computer.' Likewise, the display 1 18 may comprise any type of displa) 
technology commonly found in personal computers, laptops and the like. The networl 
interface 120 provides connectivity with the server 130 via the appropriate network am 
may comprise a network interface card, a modem,- or any other similar devices. A« 
described in greater detail below, the computer 1 10, when executing in accordance witr 
the application 122i provides a suitable platform for implementing an interface ir 
accordance with the present invention. 

Referring now to FIG. 2, a flowchart illustrating a method for displaying z 
plurality of data elements in accordance with the present invention, is provided. 
Preferably, the processing illustrated in FIG. 2 is carried out by the computer 110 as 
previously described. Beginning at block 202, a plurality of regions, as defined by region 
indicia, are displayed based on data types. In accordance with the present invention, a 
region comprises a portion of a viewable \ display area provided by a display. The 
plurality of regions may be arranged in any suitable manner, and in a preferred 
embodiment are arranged according to a 3x3 grid. An exemplary display (or graphic 
panel) 500 in accordance with a presently preferred embodiment is illustrated in FIG. 5. 
As shown in FIG. 5, the display 500 comprises a plurality of regions (or sub-panels) 502- 
5 1 8 arranged, in a 3x3 grid. However, those having ordinary skill in the art will recognize 
that the present invention heed not be limited in this manner. For example, rather than 
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providing an nxn grid, various other dimensions may be used. The various regions ar 

not restricted to rectangular or square shapes and may Instead comprise any shap 

suitable for the particular application as a matter of design choice. Additionally, pattern 

other than a grid may be used, e.g.. circular or polygonal patterns. As further shown b 

FIG.5, each of the regions 502-518 is defined according to region indicia 534. In th« 

example shown in FIG. 5, the region indicia may comprise a title 534a, a title bar 5341 

and various region borderlines 534c. Once again, those having ordinary skill in the ar 

will recognize that other types of region indicia may be used as a matter of design choice 

including variations in textures, color and shading. 

A particular feature of the present invention is the use of data types tc 

further organize the display of data elements. As used herein, data types an 

representative of the particular content or subject matter of any given data element. In < 

preferred embodiment, the data types are the result of a knowledge model used tc 

organize the data elements. An exemplary knowledge model 400 is illustrated in FIG. 4. 

The knowledge model .400 illustrated in FIG. 4. is particularly adapted for use in drug 

discovery research. As shown in FIG. 4, the knowledge model 400 comprises a plurality 

of components or data types represented as blocks. In particular, the knowledge mode) 

400 comprises a drug data component, a therapeutic area component, a disease/phenotype 

component, a protein variant component, a compound component, a target class 

component, a literature component, a protein component, a protein family component, a 

patent component, a scientist component, a locus component, an ontology component, an 

ipproval component, an organization component and finally a pathway component. The 

elationships between the various components illustrated in FIG. 4 are illustrated by a 

8 
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plurality of lines connecting each of the components. The relationships illustrated : 
FIG, 4 are representative of the fact thai a data element falling within the realm of ar 
given component may make reference, to, and thereby be related to, at least one other da 
element encompassed by a different component. For example, the name of a give 
scientist falling within the scientist component may be associated with various axtich 
within the literature component, with one or more patents encompassed by the patei 
component and may be affiliated with one or more organizations, falling under th 
organization component In essence, the knowledge model 400 generically represents th 
relationships between various components within a predeEned subject area. As a resul 
knowledge models in accordance with the present invention are necessarily dependei 
upon and defined by a given field of study or inquiry. Regardless, the component 
illustrated in the data model may be used as the basis for data types when categorizing th 
plurality, of data elements. It is understood* however, that the data types may be define^ 
and organized based on techniques other than the knowledge models as described bereu 
and the present invention is not limited in this regard. 

Referring once again to FIG. 2, indicia corresponding to a plurality of dab 
elements may be displayed in the regions based on data types at block 204. The daU 
element indicia are preferably provided by the server 130 based on the data elemen 
information 142 stored in the database 140. Data element indicia preferably comprise 
any visually-perceptible representation of data elements. For example, the data element 
indicia having reference numerals 522 and 527 in FIG. 5 consist of descriptive graphical 
symbols and text strings. As previously described, each data element in a knowledge 
base framework is categorized according to a corresponding data type. Additionally, as 

9 
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described above, each of the plurality of regions provided at block 202 is likewise 
defined according to a corresponding data type. Thus, at block 204, data elements having 
a corresponding data type equivalent to the data type of a given region are displayed in 
that region. Referring to FIG. 5, an example of this is illustrated by the protein family 
region 514 and the corresponding data elements 520, 521, displayed therein. As its name 
would imply, the region 514 is associated with the concept or subject matter of protein 
families, and the data elements displayed therein are likewise associated with protein 
families This is similarly repeated for each of the other regions and corresponding data 
types*iUustrated.in FIG. 5. Note thai the number of data elements displayed in any given 
region may vary greatly and is at least partly dependent upon the size of the respective 
regions. For example, in the central or focus region 502, a single data element indicia 
522 is displayed.* Conversely r in another region 510 associated with the protein variance 
data type, at least ten data element indicia are displayedL As shown in the title bar of the 
other region 510, only the first ten of fifteen possible data element indicium are 
displayed. In order to view the other data element indicium, up and down scroll buttons 
526, 528 may be provided. As another means of displaying additional information within 
a given a region, font increase and font decrease buttons 530, 532 may also be provided. 
The use in implementations of such buttons 526-532 are well known in the art and need 
not be described herein in further detail. 

In this manner, the processing of blocks 202 and 204 provide a technique 
whereby a plurality of data elements may be displayed based on data types. It should be 
noted that although the processing of blocks 202 and 204 is represented in FIG. 2 as 
occurring in a predefined order, it is understood that the processing represented by blocks 
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202 and -204 could be undertaken in any order and in fact could be intermingle 
Regardless, at block 206, relationships between at least the portion of the plurality of da 
element indicia may be displayed- Once again, this is illustrated in FIG. 5 where, f. 
example, a relationship 524 is illustrated between a data element indicium in a fir 
. region 518 and another data element indicium in a second region 516. Additionally, tl 
present invention incorporates the use of different types of relationship indicia. ) 
particular, a relationship may be a confirmed relationship or a potential relationship. Ft 
example, the relationship indicium having reference numeral 524 is representative of 
confirmed relationship; the relationship indicium having reference numeral 525 i 
representative of a potential relationship. Preferably, the relationship indicia used t 
represent confirmed relationships is visually different from the relationship indicia use 
to represent potential relationships. In the example of FIG. 5, this is illustrated through 
the use of solid versus dashed lines. Confirmed relationships refer to those instances v 
which it has been* verified that the contents of a given' data element make reference t< 
another data element For example, a scientific paper may make reference is a footnote 
or bibliography to another paper. These two papers would then have a confirmee 
relationship. Alternatively, potential relationships are those instances in which it i; 
unclear whether a relationship exists between two data elements. For example, twe 
chemical compounds frequently described together in a large number of articles are 
potentially related. 

In the context of the present invention, potential relationships may be 
confirmed by users and updated accordingly. Thus, at block \2G8, it is determined 
whether a confirmation of a potential relationship has been received. That is, a user is 
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free to view the contents corresponding to any given data element indicium and verify 
whether there is in fact a reference to an additional data element according to the 
potential relationship illustrated in the . display. If a confirmation of a potential 
relationship is received (through the use, for example, of an appropriate user inpu 
device), the relationship is updated at block 210 and the updated relationships art 
thereafter redisplayed at block 206. Otherwise, processing continues at block 212 wher< 
a user may engage in any one of a number of operations. In particular, at block 212, < 
user may bookmark a particular data element, set a monitor for a particular data element 
or initiate a search against the database of data elements. Techniques for monitoring anc 
searching data. elements are described in co-pending U.S. Patent Application Serial Nos. 
09/520,543; and 09/520,942. With regard to bookmarks and monitors, in a presently 
preferred embodiment, a user can select a given displayed data element indicium (e.g., by 
right-clicking on the indicium when using a mouse/cursor mechanism to get a pop-up 
menu) to be provided with a bookmarking and/or monitoring option. Selection of the 
bookmarking option causes information regarding the- particular data element selected to 
be sent to the knowledge base framework (i.e., the server 130 and the database 140), 
including information identifying the user and the data element being bookmarked, which 
information is subsequently stored. Thereafter, using a menu option or similar 
mechanism, the user can access his or her bookmarks to select a bookmark and have the 
display updated accordingly. A similar procedure is used to establish a monitor for a 
given data element. Thereafter, selection of that monitor (again, through a menu 
interface or the like) causes updated information regarding the monitored data element to 
be retrieved and presented for display. 
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As illustrated in FIG. 5, a focus region 502 may be provided as the logic* 
and visual focal points of the display 500, A focus indiciunY522 may be provided withi: 
the focus region 502 and provides the context by which the other regions 504-518 ar 
populated with related -data element indicia. In order to facilitate the exploration of 
variety of data elements, the present invention allows a user to select a given data elemeD 
indicium and thereby switch the focus of the display. This is further illustrated will 
reference to FIGS. 3 and 6. 

FIG. 3 illustrates a process for displaying data element indicia u 
accordance with the present invention, which process is preferably carried out by th« 
computer HO. At block 302 a first data element indicium, is displayed in the focu: 
region. In practice, if the display is being provided initially, the data element indiciurj 
provided in the focus region may be recalled from a previous session or may be retriever, 
based on a default value. Regardless, at block 304, additional data element indicia arc 
displayed in other regions based on their corresponding data types. Referring once again 
to FIG. 5, the focus region 502 is preferably provided as the central region from within 
the plurality of regions 502-518. However, those having ordinary skill in the art will 
recognize that any of the regions could be provided as the focus region as a matter of 
design choice. Furthermore, although not illustrated in FIG. 5. a visual graphic or cue 
may be provided to further signal the focus region to a viewer of the display. For 
example, a unique coloring scheme or shading scheme may be used to draw a user's eye 
to the focus region and thereby orient the user accordingly. Regardless, at block 306 
relationship indicia may be displayed as previously described relative to FIG. 2. 
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Thereafter at block 308, it is determined whether an indication of th- 
selection of a second data element indicium has been received. Such would .be the case 
for example, where the user desires to switch focus from the first data element indicium 
to the second data element indicium thereby causing the display to be changed, h 
practice, such an indication would be generated, for example, when a user clicks on th- 
second data element indicia (assuming a mouse/cursor mechanism) or through a simila 
action. When such an indication is received, the display is refreshed such that the seconi 
data clement indicium is thereafter displayed in the focus region according to lb 
processing at block 310. Thereafter, at block 312, at least a portion of the additional dat 
element indicia is displayed in the other regions based on the corresponding data types 
Note that the first data element indicium originally displayed in the focus region may aJs( 
be displayed in one of the other regions based on its corresponding data type 
Furthermore, when the second data element is displayed in the focus region, the data type 
associated with the focus region wilt have necessarily changed to reflect the data type 
associated with the second data element indicium. To reflect the change in focus, the 
data types associated with each of the other regions of the display may likewise change 
based on the fact that the second data element indicium is now displayed in the focus 
region. In a presently preferred embodiment, the decision as to which data types get 
lisplayed in which regions, if at all, is user controlled. That is, each user may provide 
configuration data (e.g., through the use of option menu selections) to indicate whether 
hey want to see the scientist associated with the literature in the top middle or in the 
>ottom right panel or not at all. 
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Once the display has been updated in accordance with blocks 310 and 3 1 S 
processing continues at block 314 where the relationships between the data elemer 
indicia now displayed are provided. An example of the change resulting from the switc 
th focus described above is further illustrated with respect to FIGS. 5 and 6. In pahicula 
referring now to FIG. 5, it is assumed that a user has selected, the data clement indiciur 
having reference numeral 527 to be the new focus indicium to be displayed in the focu 
region 502. As a result of this selection, an updated display 600 is provided as shown i 
FIG. 6. As illustrated in FIG. 6, the second data element indicium in FIG. 5 (i.e., the dat 
element indicium having reference numeral 527) is now displayed as the focus indiciur 
622. Note that the data type associated with the focus region now reflects the data typ 
(scientists) associated with the new focus indicium 622. Furthermore, note that th 
"region having associated therewith the proteins data type has moved and that two nev 
data types, active ingredients and gene ontology, have been added to the other regions o 
the display. Additionally, the relationship indicia, as a result in this change in focus, hav* 
been updated to illustrate the new relationships. 

•In a preferred embodiment, the present invention is implemented as : 
software development kit (SDK). In particular, the SDK allows an application developer 
to add a graphical component (also referred to below as a "navigator"), in accordance 
with, the present invention, to an application. In terms of object oriented programming 
the SDK provides a generic fhunework of class, that the developer can extend anc 
customize (for example changing colors, events, layout, panel descriptions, tool tips : 
etc.). In practice, the developer adds the graphical component to their application's 
container and provides a starting object (or^ata element) for the component. Generally, 



15 



WO 03/069506 PCT/EP03/01307 

16 

the component then calls the method supplied by. the developer to get the related data 
clement indicia (or nodes) for that object . These objects are processed and displayed on 
the screen according to their sub-panel (region) specification. In particular, the SDK 
calls the developer-provided function to get the related data elements to the starting 
object (call it set A). When set A is about to be painted/drawn on the screen, the SDK 
goes through all the data elements and if they don't have a corresponding data element 
indicia then they are created. The data element indicia are just a* graphic representation of 
the data element for the SDK's drawing elements. 

The SDK is comprised of a plurality of functional areas (application, data 
and user interface) each comprising one or more classes. The "application functional area 
provides classes used to add the graphical component to the application. It also provides 
classes that enable the application to change the graphical component's properties and 
listen td the. graphical component's events. The data functional area provides a generic 
implementation of a data component and a generic class that represents a set or collection 
of data elements. Finally, the user interface functional area provides graphical classes of 
the graphical component. Tables 1-3 below set forth the various classes for each 
functional area. In the case of the data functional area, Table 2 additionally sets forth 
functions to be provided within one of the classes (DataObject). Note that the 
functionality described below assumes the use of a mouse/cursor or similar user input 
mechanism. 
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Application Class 
Navigator Application 

NavigatorEventListener 



Na vi gatorProperties 



Description 

This class acts as "glue" to the rest of the classes an< 
presents a unified point for an application to access thi 
services of the SDK. 

This class provides a generic implementation of an even 
handler.- In practice, a developer should sub-class it 
provide their implementation, and send it to the 
Navigator Application. 

This class allows the user to set the general colors of the 
graphical component (i.e. background color/picture 
border color, non-text node colors). The SDK creates ; 
default instance of the properties class. The developer cai 
get access to the default instance using a getProperties( 
method in the Navigator Application class. 



Table 1. 



Data Class/Function 

DalaObjectCollection 
DataObject 



getTitleO - 
getDescriptionQ 



getLeftlmageO 

getRightlmageO 

getRelatedNodesO 



Description 

A collection class for data objects (data elements). * 
This class is the data representation of each node (i.e., dak 
element indicia) on the screen. The developer should suh 
class it and provide implementations of the following 
functions: 

Called by the SDK to get the title of the data element. 

Called by the SDK to get the description of the data 
element 

Called by the SDK to get the left image, if any- 
Called by the SDK to get the right image, if any. 
Called by the SDK, when a given data element is activated 
(e.g., selected), to get the related data elements for this 
instance of the DataObjecL 



Table 2. 
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GraphicsPanel 

ListenerPanel 

NodeCollection 

NodeObject 

SubPanel 



Description * 

This class provides tool-tip functionality. When a curso 
is over some data element indicium, the SDK calls th« 
getDescriptionO method on the DataObject (data elemenl 
corresponding to that data element indicium and display 
the results using the DescriptionPanel 
. This class provides the core drawing/painting routines fo 
the navigator components. It is responsible for call La 
getRelatedNodes on a DataObject and displaying th 
results. 

This class provides a generic implementation of a cursoi 
movement listener class.. 

This class provides a simple collection for th 
NodeObjects (data element indicia).. 
This class is the graphical representation of a DataObject 
i.e., a data element indicium. It knows how to draw an< 
animate itself and which other data element indicia it i 
connected to. 

This class provides the region functionality of th 
navigator component. When the GraphicsPanel calls th 
getRelatedNodes method on a DataObject (data element* 
it goes through the collection and adds the DataObject 
(data elements) to the specific panels. The panel thej 
creates the NodeObject (data element indicia) and gives i 
position/animation instructions. 



Table 3. 

The flowcharts illustrated in FIGS. 7-9 further describe use and Operatioi 
of the SDK described above. The processing illustrated in FIGS. 7-9 is carried out by th< 
computer 110. FIG. 7 illustrates the overall process of activating a data element (object 
and displaying related data element indicia (nodes). At block 702, an initial object i: 
obtained either from the database or a static entry point for the application. The iniria 
object is obtained either upon initiation of the graphics component or Upon selection of 5 
data element indicia corresponding to the object being obtained. At block 704, node! 
related to the initial object are obtained. Using the SDK described above, th< 
getRelatedNodes function sends a request to the database 140 which, in turn, respond* 
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wilh a list of related data dements well as information regarding how the dati 
elements are to be displayed. In particular, getRelatedNodes reUirns a set 
(DataObjectCollection) of data elements that kre related to the data element on which 
getRelatedNodes was called. For example, if getRelatedNodes is called on a data 
clement that represents a scientist, then the function would return a collection that might 
have a list of documents, other scientist who have co-authored papers with him, his 
organization, etc. At block 706, the list returned at block 704 is scanned to determine 
that specific data type corresponding to each of the returned nodes, thereby determining 
which sub-panels (regions) each returned node should be associated with. 

At block 708, region (or sub-panel) indicia is drawn to an off-screen 
buffer. The use of off-screen or video buffers and techniques for drawing graphic images 
therein are well-known in the art and .need not be described in greater detail here. 
Additionally, at block. 710, data element .indicia (and the relationships there between) 
corresponding to each of the regions depicted in the off-screen buffer are likewise drawn 
in the off-screen buffer. In this manner, an entire graphics panel (e.g., display 500) is. 
composed in the off-screen buffer. Thereafter, at block 712, the contents of the off- 
screen buffer arc presented on a suitable display 1 1 8 in accordance with well-known 
graphics processing techniques. At this point, a display such as the one indicated in FIG. 
5 is displayed on the display screen. Thereafter, at blocks 714-718, it is determined 
whether a paint or mouse event has been received. - In the context of the present 
invention, a paint event is any event requiring the off-screen buffer to be redrawn to the 
display, and a mouse event is any event in which a new object has been selected. If- a 
paint event occurs, the off-screen buffer is redrawn on the display at block 712. If a 



19 



WO 03/069S06 nr , 

PCT/EP03/0I307 

20 

mouse event occurs, processing continues at block 704 based on the newly select, 
object 

FIG. 8 illustrates the processing of block 706 in greater detail, particular 
the addition of a node to a sub-panel. At block 802, a data element (object) is added to : 
internal collection, i.e., data elements corresponding to a specific sub-panel. At b!o< 
804, it is determined whether the data element already has a graphical representatk 
(data element indicium) associated therewith. If not, a data element indicium is created 
block 806 using known techniques. In a presently preferred embodiment, for tl 
purposes of animation, the starting point for the data element indicium is set as tl 
middle of the screen so that during a drawing cycle the data element indicium will mo\ 
from the center of the screen to its sub-panel position. 

Once such a data element indicium has been created, or if one alread 
existed, processing continues at block 808 where the data element indicium (node) i 
associated with, a corresponding region (sub-panel) based on data type. Additionally, z 
this step, any information regarding animation of the data, element indicium is set. A 
noted above, nodes are preferably, but not necessarily, animated during the drawin, 
process. Currently, these animations comprise moving, growing, sluinking anc 
collapsing. When a node is activated (i.e.. selected), nodes that are already on thescreer 
and that need to remain on the screen move to new locations; new nodes move and gro* 
from the new active node's current position; the new active node moves to the focus 
region and the nodes thai are no longer required on the.screen will shrink and move 
awards the center and finally disappear. Those having ordinary skill in the art will 
cognized that other animation schemes may be used; the present invention is not 



20 



WO 03/069506 PCT/EP03/01307 
limited in this regard. Thereafter, at block 810, the information regarding the text 
associated with the data element indicium as well as the region with which it is associated 
arc updated at block 810. In this manner, regions or sub-panels may be updated in 
accordance with changes instigated by a user. 

Finally, FIG. 9 illustrates the processing of block 710 in greater detail, 
particularly the drawing of a data element indicium (node) in the off-screen buffer. At 
block 902, it is determined whether a given data element indicium has been previously 
drawn. If not, at block 914, the appropriate function calls are made to retrieve the title of 
the data element as well as initialize animation to be associated with the data element In 
• particular, initialization of the animation includes setting up the font size, the position, 
etc, for animation. ... - 

If the data element indicium has been previously drawn, processing 
continues at block 904 where it is determined if the size of the data element indicium has 
changed, for example, as a result of animations, or if the cursor is moved oyer a node for 
"which the corresponding text has been previously truncated. If. so, or if processing is 
continuing from block 914, processing continues at block 916 where the amount of text 
displayed as part of the data element indicium is recalculated. In a preferred 
embodiment, each data element indicium may comprise a graphical image subcomponent 
(e.g., the outline of a person in the case of the scientist data type) and a text 
subcomponent (e.g., the name of the person to whom the data element indicium 
corresponds in the case of the scientist data type). Thus, for example, if the size of the 
data element indicium has changed such that it is now larger, some portion of the text 
subcomponent may need to be truncated. Conversely, if the data element indicium has 
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changed such that it is now smaller, the amount of truncation needed may be reduced or 
eliminated altogether. In the case where the cursor moves over a node having previously 
truncated text, the node is expanded to show the full text for so long as the cursor remains 
over the node. 

It after determining that the data element indicium has not changed in 
size, processing continues at block 906 where it is determined if there is any pending 
animation for the dat^ element In practice, animation is done in frames. So; for a 
"move" animation, a object moves a small increment oil frame 1, another small increment 
on the next frame, etc. Therefore if the object has not reached the final destination it will 
still have pending animation operations. If so; or if processing is continuing from block 
916, processing continues at block 918 where the data element indicium representative of 
the data element is reduced in size or moved based on the pending animation 
* corresponding thereto. Thereafter, processing nearly equivalent to blocks 904 and 916 is 
executed at blocks 920 and 922, i.e., recalculating the amount of text to be displayed if 
the size of the data element indicium has changed as a result of the ahiraatioDL If the size 
has not changed, processing continues at block 924 where it is determined if the data 
element indicia is still visible. Because of the animation that occurred, it is possible that 
the data element indicium corresponding, to the data element may no longer be visible. If 
not, the data element indicium is removed from off-screen buffer and from the class 
representative of the graphic panel (display). 

If the data element indicium is still visible despite the animation, or if 
there was no pending animation at block 906, processing continues at block 908 where 
the colors for the data element indicium as well as the region indicia are set according to 
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a predetermined format In a preferred embodiment, a user can change all of the colors in 
the navigator. Color for the node is the color that is used to display the text, whereas 
navigator colors are the color for the border of a node, the link color, the background 
color, etc. Thereafter, at block 910, the border defining the node and it corresponding 
text are drawn and, at block 9 1 2, the relationship indicia are also drawn. To this end, the 
getLeftlmage function, to retrieve the symbol used to represent the node, and 
getRightlniage function, to retrieve the text to be displayed, are called at block 910. 

The present invention overcomes the limitations of prior art 
methodologies by not only data element indicia and corresponding relationships there 
between, but by doing so based on data types. To this end, a plurality of regions are 
defined based on a corresponding plurality of data types, and region indicia are displayed 
accordingly. Data element indicia are displayed in the plurality of regions based on 
(Hatching data types of the data element indicia and the plurality of regions. 
Relationships between the data element indicia, which relationships are user modifiable, 
nay likewise be. displayed. A selected data element indicium is preferably displayed in a 
;bcus region of the plurality of regions, and subsequent selections of other data element 
ndicia for display in thejfocus region causes the plurality of regions, and the data clement 
ndicia displayed therein, to be updated accordingly. In the manner, the present invention 
>rovides an improved technique for displaying information. 

The foregoing description of a preferred embodiment of the invention has 
»een presented for purposes of illustration and description, it is not intended to be 
ocbaustive or to limit invention to the precise form disclosed. The description was 
elected to best explain the principles of the invention and practical application of these 
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principles to enable others skilled in the art to best utilize the invention and varioi 
embodiments, and various modifications as are suited to the particular use contemplate! 
It is intended that the scope of the invention not be limited by the specification, but t 
defined by the claims set forth below. 
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V/hat is claimed is: 

1. In a computer comprising a display, a method for displaying data element 
indicia representative of a plurality of data elements interrelated by a plurality ol 
relationships, wherein the plurality of data elements comprise a plurality of data type; 
and each indicium of the data element indicia has a corresponding data type, the methoc 
comprising: 

displaying region indicia representative of a plurality of regions on the display, 
wherein each region of the plurality of regions corresponds to one of* the plurality of data 
types; and 

displaying the data element indicia according to the plurality of regions, wherein 
each indicium of the data element indicia is displayed in a region of the plurality ol 
regions according to the corresponding data type. 

2. The method of claim I, further comprising: 

displaying, relative to the data element indicia, relationship indicia representative 
of the plurality of relationships. 

3. The method of claim 2, wherein the relationship indicia comprise at least 
one relationship indicium representative of a confirmed relationship between related data 
elements of the plurality of data elements. 
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4. The method of claim 3, wherein the relationship indicia comprise at leas 
one relationship indicium representative of a potential relationship between potential!; 
related data elements of the plurality of data elements. 

5. The method of claim 4, further comprising: 

receiving, relative to one of the at least one relationship indicium; an indicatio 
confirming a potential relationship between potentially related data elements; and 

converting the one of the at least one relationship indicium to a relationshi 
indicium representative of a confinned relationship. 

6. The method of claim 1, wherein the region indicia define a grid pattern. - 

7. The method of claim 6, wherein the region indicia define a 3x3 gri* 

pattern. 

8. The method of claim 1 , further comprising: 

displaying a first indicium of the data element indicia as a focus indicium 
wherein the region indicia are based on the first indicium; and 

displaying relationship indicia representative of the plurality of relationship: 
relative to the first indicium. 
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9. The method of claim 8. wherein the step of displaying the first indiciurr. 
further comprises displaying 'the first indicium in a central region of the plurality Ol 
regions. 

10. The method of claim 8, further comprising: 

receiving a selection indication representative of selection of a second indicium o: 
the data element indicia as Che focus indicium; 

displaying the region indicia based on the second indicium; and 
displaying the relationship indicia relative to the second indicium. 

1 1 . The method of claim 10, further comprising. 

displaying the second indicium in a central region of the of the plurality o 
regions. 

12. A computer-readable medium having stored thereon computer-executabh 
instructions for implementing the method of claim 1 . 

13. In a computer comprising a display, a method for displaying data elemen 
indicia representative of a plurality of data elements interrelated by a plurality o 
relationships, wherein the plurality, of data elements comprise a plurality of data type; 
and each indicium of the data element indicia has a corresponding data type, the methoc 
comprising: 

displaying an indicium of a first data element in a focus region of the display;* 
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displaying indicia of additional dala elements, including an indicium of a second 
data element, in other Tegioos of the display based on data types corresponding to the 
additional data elements, wherein each of the other regions is associated with one of the 
data types; 

receiving a selection indication representative of selection of the indicium of the 
second data element; 

in response to the selection indication, displaying the indicium of the second data 
element in the focus region of the display; and 

in response to the selection indication, displaying at least a portion of the indicia 
of the additional data elements in the other regions of the display based on the data types 
corresponding to the additional data elements. 

14. The method of claim 13, further comprising: 

in response to the selection indication, displaying the indicium of the first data 
element in one of the other regions of the display. 

1 5. The method of claim 13, further comprising: 

in response to the selection indication, displaying the focus region of the display 
and the other regions of the display based on the indicium of the second data element 
being displayed in the focus region. 

1 6. The method of claim 1 3, further comprising: 
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displaying, relative to the indicium of the first data element and the indicia off 
additional data, elements, relationship indicia representative of the plurality 
relationships based on the indicium of the first data element being displayed in the foa 
region. 

17. The method of claim 16, further comprising: 

displaying, relative to the indicium of the second data element and the at least 
portion pf the indicia of the additional data elements, relationship indicia representativ 
of the plurality, of relationships based on the indicium of the second data element bein 
displayed in the focus region.. 

. 18. The method of claim 16, wherein the relationship indicia comprise at leas 

one relationship indicium representative of a confirmed relationship between related dat; 

• /. 

elements of the plurality of data elements. 

i 

19. The method of claim 1 8, wherein the relationship indicia comprise at leas! 
one relationship indicium representative of a potential relationship between potentially 
related data elements of the plurality of data elements. 

• 20. The method of claim 19, further comprising: 

receiving, relative to one of the at least one relationship indicium, an indication 
onfijming a potentiaJ relationship between potentially related data elements; and 
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converting the one of the at.Ieast one relationship indicium to a relationship 
indicium representative of a confirmed relationship. 

21. The method of claim 13, wherein the focus region and the other regions 
form a part of a grid pattern. 

22. The method of claim 21, wherein the focus region and the other regions 
form a part of a 3x3 grid pattern. 

23. A computer- readable medium having stored thereon computer-executable 
instructions for implementing the method of claim 13. 

24. An apparatus for displaying data element indicia representative of a 
plurality of data elements interrelated by a plurality of relationships, wherein the plurality 
of data elements comprise a plurality of data types and each indicium of the data element 
indicia has a corresponding data type, the apparatus comprising: 

. a display; 

at least one processor coupled to the display; and 

at least one memory device, coupled to the at least one processor, having stored 
thereon executable instructions that, when executed by the at least one processor, cause 
the at least one processor to: 
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display region indicia representative of a plurality of regions on the display, 
wherein each region of the plurality of regions corresponds to one of the plurality of date 
. types; and 

display the data element indicia according to the plurality of regions, whereir 
each indicium of the data element indicia is displayed in a region of the plurality o; 
regions according to the corresponding data type. 

25. The apparatus of claim 24, wherein the at least one memory device furthei 
comprises executable instructions that, when executed by the at least one processor, caust 
the at least one processor to: 

display, relative to the data element indicia, relationship indicia representative o: 
the plurality of relationships on the display. 

26. The apparatus of claim 25, further comprising a user input device couplec 
to the processor, and wherein the at least one memory device further comprise* 
executable instructions that, when executed by the at . least one processor, cause the aJ 
least one processor to: 

receive, via the user input device and relative to one of the at least-one 
relationship indicium, an indication confirming a potential relationship between 
potentially related data elements of the plurality of data elements; and 

convert the one of the at least one relationship indicium to a relationship indicium 
representative of a confirmed relationship between related data elements of the plurality 
of data elements. 
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27. The apparatus of claim 24, wherein the region indicia define a grid patten 

28. The apparatus of claim 24, wherein the at least one memory device furth< 
comprises executable instructions that, when executed by the at least one processor, cau< 
the at least one processor to: 

display a first indicium of the data element indicia as a focus indicium on tb 
display^ wherein the region indicia are based on the first indicium; and 

display relationship indicia representative of the plurality of relationships relativ 
to the fust indicium on the display. ^ 

29. The apparatus of claim 28, further comprising a user input device couple* 
to the processor, and wherein the at least one memory s device further comprise: 
executable instructions that, when executed by the at least one processor, cause the a 
least one processor to: 

receive, via the user input device, a selection indication representative of selectior 
of a second indicium of the data element indicia as the focus indicium; 

display the region indicia based on the second indicium on the display; and 
display the relationship indicia relative to the second indicium on the display. 

t 30. The apparatus of claim 24, wherein the executable instructions form a part 
>f a browser application stored in the al least one memory device. 
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31. An apparatus for displaying data element indicia representative of a 
plurality of data elements interrelated by a plurality of relationships; wherein the plurality 
of data elements comprise a plurality of data types and each indicium of the data element 
indicia has a corresponding data type, the apparatus comprising: 

a display; 

a user input device; 

at least one processor coupled to the display and the user input device; and 
at least one memory device, coupled to the at least one processor, having stored 
thereon executable instructions that, when executed by the at least one processor, cause 

the at least one processor to: 

display an indicium of a first data element in a focus region of the display; 

display indicia of additional data elements, including an indicium of a second data 
element, in other regions of the display based on data types corresponding to the 
additional data elements, wherein each of the other regions is associated with one of the 
data types; 

receive, via the user input device, a selection indication representative of selection 
of the indicium of the second data element; 

display, responsive to the Selection indication, the indicium of the second data 
element in the focus region of the display; and 

display, responsive to the selection indication, at least a portion of the indicia of 
the additional data elements in the other regions of the display based on the data types 
corresponding to the additional data elements. 
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. 32. The apparatus of claim 31, wherein the at least one memory device furtht 
comprises executable instructions that, when executed by the at least one processor, caus 
the at least one processor to: 

display, in response to the. selection indication, the indicium of the first dat 
element in one of the other regions of the display. 

33. The apparatus of claim 31, wherein the at least one memory device further 
comprises executable instructions that, when executed by the at least one processor, cause 
the at least one processor to: 

display, in response to the selection indication, the focus region of the display and 
the other regions of the display based on the indicium of the second data element being 
displayed in the focus region- 

34. The apparatus of claim 3 1 , wherein the at least one memory device further 
comprises executable instructions that, when executed by the at least one processor, cause 
the at least one processor to: 

display, relative to the indicium of the first data element and the indicia of the. 
additional data elements; relationship indicia representative of the plurality of 
relationships based on the indicium of the first data element being displayed in the focus 
region. 
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35. The apparatus of claim 34, wherein the at Jeast one memory device furti 
comprises executable instructions that,* when executed by the at least one processor, cat 
the at least one processor to: 

display, relative to the. indicium of the second data element and the at least 
portion of the indicia of the additional data elements, relationship indicia representati 
of the plurality of relationships based on the indicium of the second data element beij 
displayed in the focus region. 

36. The apparatus of claim 31, wherein the focus region and the other regiot 
form a part of a grid pattern. 

37. The apparatus of claim 31 , wherein the executable instructions form a pai 
of a browser application stored in the at least one memory device. 
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